System estimation method and program, recording medium, and system estimation device

ABSTRACT

It is possible to establish an estimation method capable of logically and optimally deciding a forgetting coefficient and develop an estimation algorithm and a high-speed algorithm which are numerically stable. Firstly, a Processing section reads out or receives an upper limit value γ f  from a storage section or an input section (S 101 ). The.processing section decides a forgetting coefficient ρ by equation (15) (S 103 ). After this, according to the forgetting coefficient ρ, the processing section executes a hyper H ∞  filter of equations (10-13) (S 105 ). The processing section ( 101 ) calculates the existence condition of equation (17) (or equation (18) which will be given later) (S 107 ). When the existence condition is satisfied at all the times (S 109 ), γ f  is decreased by Δγ and the same processing is repeated (S 111 ). On the other hand, when the existence condition is not satisfied by a certain γ f  (S 109 ), the Δγ is added to the γ f  and the sum is output to an output section and/or stored in the storage section as an optimal value γ f   OP  of the γ f  (S 113 ).

CROSS REFERENCES TO RELATED APPLICATION

This application is a national phase application based upon priority International PCT Patent Application No. PCT/JP2004/011568 filed Aug. 05, 2004, International Publication No. WO 2005/015737 A1published Feb. 17, 2005, which is based upon priority Japanese Application No. JP2003-291614 filed Aug. 11, 2003.

BACKGROUND OF THE INVENTION

1. Technical Field

The present invention relates to a system estimation method and program, a recording medium, and a system estimation device, and particularly to a system estimation method and program, a recording medium, and a system estimation device, in which the generation of robustness in state estimation and the optimization of a forgetting factor are simultaneously realized by using a fast H_(∞) filtering algorithm of a hyper H_(∞) filter developed on the basis of an H_(∞) evaluation criterion.

2. Background Art

In general, system estimation means estimating a parameter of a mathematical model (transfer function, impulse response, etc.) of an input/output relation of a system based on input/output data. Typical application examples include an echo canceller in international communication, an automatic equalizer in data communication, an echo canceller and sound field reproduction in a sound system, active noise control in a vehicle etc. and the like. For more information, see non-patent document 1: “DIGITAL SIGNAL PROCESSING HANDBOOK” 1993, The Institute of Electronics, Information and Communication Engineers, and the like.

(Basic Principle)

FIG. 8 shows an example of a structural view for system estimation (unknown system may be expressed by an IIR (Infinite Impulse Response) filter).

This system includes an unknown system 1 and an adaptive filter 2. The adaptive filter 2 includes an FIR digital filter 3 and an adaptive algorithm 4.

Hereinafter, an example of an output error method to identify the unknown system 1 will be described. Here, u_(k) denotes an input of the unknown system 1, d_(k) denotes an output of the system, which is a desired signal, and dˆ_(k) denotes an output of the filter. (Incidentally, “ˆ” means an estimated value and should be placed directly above a character, however, it is placed at the upper right of the character for input convenience. The same applies hereinafter.).

Since an impulse response is generally used as a parameter of an unknown system, the adaptive filter adjusts a coefficient of the FIR digital filter 3 by the adaptive algorithm so as to minimize an evaluation error e_(k=d) _(k−dˆ) _(k) of the figure.

Besides, conventionally, a Kalman filter based on an update expression (Riccati equation) of an error covariance matrix has been widely used for the estimation of a parameter (state) of a system. The details are disclosed in non-patent document 2: S. Haykin: Adaptive filter theory, Prentice-Hall (1996) and the like.

Hereinafter, the basic principle of the Kalman filter will be described.

A minimum variance estimate xˆ_(k|k) of a state x_(k) of a linear system expressed in a state space model as indicated by the following expression: x _(k+1)=ρ^(−1/2) x _(k) , y _(k) =H _(k) x _(k) +v _(k)  (1) is obtained by using an error covariance matrix Σˆ_(k|k−1) of the state as follows. $\begin{matrix} {{{\hat{x}}_{k|k} = {{\hat{x}}_{k|{k - 1}} + {K_{k}\left( {y_{k} - {H_{k}{\hat{x}}_{k|{k - 1}}}} \right)}}}{{\hat{x}}_{{k + 1}|k} = {\rho^{- \frac{1}{2}}{\hat{x}}_{k|k}}}} & (2) \\ {{K_{k} = {{\hat{\Sigma}}_{k|{k - 1}}{H_{k}^{T}\left( {\rho + {H_{k}{\hat{\Sigma}}_{k|{k - 1}}H_{k}^{T}}} \right)}^{- 1}}}{{\hat{\Sigma}}_{k|k} = {{\hat{\Sigma}}_{k|{k - 1}} - {K_{k}H_{k}{\hat{\Sigma}}_{k|{k - 1}}}}}} & (3) \\ {{{\hat{\Sigma}}_{{k + 1}|k} = {{\hat{\Sigma}}_{k|k}/\rho}}{{where},}} & (4) \\ {{{\hat{x}}_{0|{- 1}} = 0},\quad{{\hat{\Sigma}}_{0|{- 1}} = {ɛ_{0}I}},\quad{ɛ_{0} > 0}} & (5) \end{matrix}$

-   x_(k): State vector or simply a state; unknown and this is an object     of estimation. -   y_(k): Observation signal; input of a filter and known. -   H_(k): Observation matrix; known. -   V_(k): Observation noise; unknown. -   ρ: Forgetting factor; generally determined by trial and error. -   K_(k): Filter gain; obtained from matrix Σˆ_(k|k−1). -   Σˆ_(k|k): Corresponds to the covariance matrix of an error of     xˆ_(k|k); obtained by a Riccati equation. -   Σˆ_(k+1|k): Corresponds to the covariance matrix of an error of -   xˆ_(k+1|k); obtained by the Riccati equation.     Σˆ_(1|0): Corresponds to the covariance matrix in an initial state;     although originally unknown, ε₀I is used for convenience.

The present inventor has already proposed a system identification algorithm by a fast H_(∞) filter (see patent document 1). This is such that an H_(∞) evaluation criterion is newly determined for system identification, and a fast algorithm for the hyper H_(∞) filter based thereon is developed, while a fast time-varying system identification method based on this fast H_(∞) filtering algorithm is proposed. The fast H_(∞) filtering algorithm can track a time-varying system which changes rapidly with a computational complexity of O (N) per unit-time step. It matches perfectly with a fast Kalman filtering algorithm at the limit of the upper limit value. By the system identification as stated above, it is possible to realize the fast real-time identification and estimation of the time-invariant and time-varying systems.

Incidentally, with respect to methods normally known in the field of the system estimation, see, for example, non-patent documents b 2 and 3.

(Applied Example to Echo Canceller)

In a long distance telephone circuit such as an international telephone, a four-wire circuit is used from the reason of signal amplification and the like. On the other hand, since a subscriber's circuit has a relatively short distance, a two-wire circuit is used.

FIG. 9 is an explanatory view concerning a communication system and an echo. A hybrid transformer as shown in the figure is introduced at a connection part between the two-wire circuit and the four-wire circuit, and impedance matching is performed. When the impedance matching is complete, a signal (sound) from a speaker B reaches only a speaker A. However, in general, it is difficult to realize the complete matching, and there occurs a phenomenon in which part of the received signal leaks to the four-wire circuit, and returns to the receiver (speaker A) after being amplified. This is an echo (echo). As a transmission distance becomes long (as a delay time becomes long), the influence of the echo becomes large, and the quality of a telephone call is remarkably deteriorated (in the pulse transmission, even in the case of short distance, the echo has a large influence on the deterioration of a telephone call).

FIG. 10 is a principle view of an echo canceller.

Then, as shown in the figure, the echo canceller (echo canceller) is introduced, an impulse response of an echo path is successively estimated by using a received signal which can be directly observed and an echo, and a pseudo-echo obtained by using it is subtracted from the actual echo to cancel the echo and to remove it.

The estimation of the impulse response of the echo path is performed so that the mean square error of a residual echo e_(k) becomes minimum. At this time, elements to interfere with the estimation of the echo path are circuit noise and a signal (sound) from the speaker A. In general, when two speakers simultaneously start to speak (double talk), the estimation of the impulse response is suspended. Besides, since the impulse response length of the hybrid transformer is about 50 [ms], when the sampling period is made 125 [μs], the order of the impulse response of the echo path becomes actually about 400.

Non-patent document 1

“DIGITAL SIGNAL PROCESSING HANDBOOK” 1993 The Institute of Electronics, Information and Communication Engineers

Non-patent document 2

S. Haykin: Adaptive filter theory, Prentice-Hall (1996)

Non-patent document 3

B. Hassibi, A. H. Sayed, and T. Kailath: “Indefinite-Quadratic Estimation and Control”, SIAM (₁₉₉₆)

Patent document ₁

JP-A-₂₀₀₂-₁₃₅₁₇₁

BRIEF SUMMARY OF INVENTION

However, in the conventional Kalman filter including the forgetting factor ρ as in the expressions (1) to (5), the value of the forgetting factor ρ must be determined by trial and error and a very long time has been required. Further, there has been no means for judging whether the determined value of the forgetting factor ρ is an optimal value.

Besides, with respect to the error covariance matrix used in the Kalman filter, it is known that a quadratic form to an arbitrary vector, which is originally not zero, is always positive (hereinafter referred to as “positive definite”), however, in the case where calculation is performed by a computer at single precision, the quadratic form becomes negative (hereinafter referred to as “negative definite”), and becomes numerically unstable. Besides, since the amount of calculation is O(N²) (or O(N³)), in the case where the dimension N of the state vector x_(k) is large, the number of times of arithmetic operation per time step is rapidly increased, and it has not been suitable for a real-time processing.

In view of the above, the present invention has an object to establish an estimation method which can theoretically optimally determine a forgetting factor, and to develop an estimation algorithm and a fast algorithm which are numerically stable. Besides, the invention has an object to provide a system estimation method which can be applied to an echo canceller in a communication system or a sound system, sound field reproduction, noise control and the like.

In order to solve the problem, according to the invention, a newly devised H_(∞) optimization method is used to derive a state estimation algorithm in which a forgetting factor can be optimally determined. Further, instead of an error covariance matrix which should always have the positive definite, its factor matrix is updated, so that an estimation algorithm and a fast algorithm, which are numerically stable, are developed.

According to first solving means of the invention, a system estimation method and program and a computer readable recording medium recording the program are for making state estimation robust and optimizing a forgetting factor ρsimultaneously in an estimation algorithm, in which

for a state space model expressed by following expressions: x _(k+1) =F _(k) x _(k) +G _(k) w _(k) y _(k) =H _(k) x _(k) +v _(k) z_(k) =H _(k) x _(k) here,

-   x_(k): a state vector or simply a state, -   w_(k): a system noise, -   v_(k): an observation noise, -   y_(k): an observation signal, -   z_(k): an output signal, -   F_(k): dynamics of a system, and -   G_(k): a drive matrix,

a maximum energy gain to a filter error from a disturbance weighted with the forgetting factor ρ as an evaluation criterion is suppressed to be smaller than a term corresponding to a previously given upper limit value γ_(f), and

the system estimation method, the system estimation program for causing a computer to execute respective steps, and the computer readable recording medium recording the program, includes

a step at which a processing section inputs the upper limit value γ_(f), the observation signal y_(k) as an input of a filter and a value including an observation matrix H_(k) from a storage section or an input section,

a step at which the processing section determines the forgetting factor ρ relevant to the state space model in accordance with the upper limit value γ_(f),

a step at which the processing section reads out an initial value or a value including the observation matrix H_(k) at a time from the storage section and uses the forgetting factor ρ to execute a hyper H_(∞) filter expressed by a following expression: xˆ _(k|k) =F _(k−1) xˆ _(k−1|k−1) =K _(s,k)(y _(k) −H _(k) F _(k−1) xˆ _(k−1|k−1)) here,

-   xˆ_(k|k); an estimated value of a state x_(k) at a time k using     observation signals y₀ to y_(k,) -   F_(k): dynamics of the system, and -   K_(s,k); a filter gain,

a step at which the processing section stores an obtained value relating to the hyper H_(∞) filter into the storage section,

a step at which the processing section calculates an existence condition based on the upper limit value γ_(f) and the forgetting factor ρ by the observation matrix H_(i) and the filter gain K_(s,i), and

a step at which the processing section sets the upper limit value to be small within a range where the existence condition is satisfied at each time and stores the value into the storage section by decreasing the upper limit value γ_(f) and repeating the step of executing the hyper H_(∞) filter.

Besides, according to second solving means of the invention,

a system estimation device is for making state estimation robust and optimizing a forgetting factor ρ simultaneously in an estimation algorithm, in which for a state space model expressed by following expressions: x _(k+1) =F _(k) x _(k) +G _(k) w _(k) y _(k) =H _(k) x _(k) +v _(k) z _(k) =H _(k) x _(k) here,

-   x_(k): a state vector or simply a state, -   w_(k): a system noise, -   v_(k): an observation noise, -   y_(k): an observation signal, -   z_(k): an output signal, -   F_(k): dynamics of a system, and -   G_(k): a drive matrix,

a maximum energy gain to a filter error from a disturbance weighted with the forgetting factor ρ as an evaluation criterion is suppressed to be smaller than a term corresponding to a previously given upper limit value γ_(f),

the system estimation device includes:

a processing section to execute the estimation algorithm; and

a storage section to which reading and/or writing is performed by the processing section and which stores respective observed values, set values, and estimated values relevant to the state space model,

the processing section inputs the upper limit value γ_(f), the observation signal y_(k) as an input of a filter and a value including an observation matrix H_(k) from the storage section or an input section, the processing section determines the forgetting factor ρrelevant to the state space model in accordance with the upper limit value γ_(f),

the processing section reads out an initial value or a value including the observation matrix H_(k) at a time from the storage section and uses the forgetting factor ρ to execute a hyper H_(∞) filter expressed by a following expression: xˆ _(k|k) =F _(k−1) xˆ _(k−1|k−1) =K _(s,k)(y _(k) −H _(k) F _(k−1) xˆ _(k−1|k−1)) here,

-   xˆ_(k|k); an estimated value of a state x_(k) at a time k using     observation signals y₀ to y_(k,) -   F_(k): dynamics of the system, and -   K_(s,k); a filter gain,

the processing section stores an obtained value relating to the hyper H_(∞) filter into the storage section,

the processing section calculates an existence condition based on the upper limit value γ_(f) and the forgetting factor ρby the observation matrix H_(i) and the filter gain K_(s,i), and

the processing part sets the upper limit value to be small within a range where the existence condition is satisfied at each time and stores the value into the storage section by decreasing the upper limit value γ_(f) and repeating the step of executing the hyper H_(∞) filter.

According to the estimation method of the invention, the forgetting factor can be optimally determined, and the algorithm can stably operate even in the case of single precision, and accordingly, high performance can be realized at low cost. In general, in a normal civil communication equipment, calculation is often performed at single precision in view of cost and speed. Thus, as the practical state estimation algorithm, the invention would have effects in various industrial fields.

A more detailed description of the invention is provided in the following description and appended claims taken in conjunction with the accompanying drawing.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a structural view of hardware of an embodiment.

FIG. 2 is a flowchart concerning the generation of robustness of an H_(∞) filter and the optimization of a forgetting factor ρ.

FIG. 3 is a flowchart of an algorithm of the H_(∞) filter (S105) in FIG. 2.

FIG. 4 is an explanatory view of a square root array algorithm of Theorem 2.

FIG. 5 is a flowchart of a fast algorithm of Theorem 3, which is numerically stable.

FIG. 6 is a view showing values of an impulse response {h_(i)}_(i=0) ^(23.)

FIG. 7 shows an estimation result of the impulse response by the fast algorithm of Theorem 3, which is numerically stable.

FIG. 8 is a structural view for system estimation.

FIG. 9 is an explanatory view of a communication system and an echo.

FIG. 10 is a principle view of an echo canceller.

DETAILED DESCRIPTION OF THE INVENTION

The following is a detailed description and explanation of the preferred embodiments and best modes for embodying the invention along with some proofs thereof.

Hereinafter, embodiments of the invention will be described.

1. Explanation of Symbols

First, main symbols used in the embodiments of the invention and whether they are known or unknown will be described.

-   x_(k): State vector or simply a state; unknown and this is an object     of the estimation. -   x_(o): Initial state; unknown. -   w_(k): System noise; unknown. -   v_(k): Observation noise; unknown. -   y_(k): Observation signal; input of a filter and known. -   z_(k): Output signal; unknown. -   F_(k): Dynamics of a system; known. -   G_(k): Drive matrix; known at the time of execution. -   H_(k): Observation matrix; known. -   xˆ_(k|k): Estimated value of a state x_(k) at a time k, using     observation signals y₀ to y_(k); given by a filter equation. -   xˆ_(k+1|k): Estimated value of a state X_(k+1) at a time k+1 using     the observation symbols y₀ to y_(k); given by the filter equation. -   xˆ_(k+1|k): Initial estimated value of a state; originally unknown,     however, 0 is used for convenience. -   Σˆ_(k|k): Corresponds to a covariance matrix of an error of xˆk|k;     given by a Riccati equation. -   Σˆ_(k+1|k): Corresponds to a covariance matrix of an error of     xˆ_(k+1|k); given by the Riccati equation. -   Σˆ_(1|0): Corresponds to a covariance matrix in an initial state;     originally unknown, however, ε₀I is used for convenience. -   K_(s,k): Filter gain; obtained from a matrix Σˆ_(k|k−1.) -   ρ: Forgetting factor; in the case of Theorems 1 to 3, when γ_(f) is     determined, it is automatically determined by ρ=1−χ(γ_(f)). -   e_(f,i): Filter error -   R_(e,k): Auxiliary variable

Incidentally, “ˆ” and “v” placed above the symbol mean estimated values. Besides, “˜”, “−”, “U” and the like are symbols added for convenience. Although these symbols are placed at the upper right of characters for input convenience, as indicated in mathematical expressions, they are the same as those placed directly above the characters. Besides, x, w and the like are vectors, H, G, K, R, Σ and the like are matrixes and should be expressed by thick letters as indicated in the mathematical expressions, however, they are expressed in normal letters for input convenience.

2. Hardware and Program for System Estimation

The system estimation or the system estimation device and system can be provided by a system estimation program for causing a computer to execute respective procedures, a computer readable recording medium recording the system estimation program, a program product including the system estimation program and capable of being loaded into an internal memory of a computer, a computer, such as a server, including the program, and the like.

FIG. 1 is a structural view of hardware of this embodiment.

This hardware includes a processing section 101 which is a central processing unit (CPU), an input section 102, an output section 103, a display section 104 and a storage section 105. Besides, the processing section 101, the input section 102, the output section 103, the display section 104 and the storage section 105 are connected by suitable connection means such as a star or a bus. Known data indicated in “1. Explanation of Symbols” and subjected to the system estimation are stored in the storage section 105 as the need arises. Besides, unknown and known data, calculated data relating to the hyper H_(∞) filter, and other data are written and/or read by the processing section 101 as the need arises.

3. Hyper H_(∞) Filter by Which Forgetting Factor Can Be Optimally Determined

(Theorem 1)

Consideration is given to a state space model as indicated by following expressions. x _(k+1) =F _(k) x _(k) +G w _(k) ,w _(k) ,x _(k) ∈R ^(N)  (6) Y _(k) =H _(k) x _(k) +v _(k) ,y _(k) ,v _(k) ∈R  7) z _(k) =H _(k) x _(k) ,z _(k) ∈R,H _(k)∈R^(1×N) ,k= _(0,1) , . . . , L  (8)

An H_(∞) evaluation criterion as indicated by the following expression is proposed for the state space model as described above. $\begin{matrix} {{\sup\limits_{x_{0},{\{ w_{i}\}},{\{ v_{i}\}}} \cdot \frac{\sum\limits_{i = 0}^{k}{{e_{f,i}}^{2}/\rho}}{{{x_{0} - {\overset{\Cup}{x}}_{0|{- 1}}}}_{\Sigma_{0}^{- 1}}^{2} + {\sum\limits_{i = 0}^{k}{{v_{i}}^{2}/\rho}}}} < \gamma_{f}^{2}} & (9) \end{matrix}$

A state estimated value xˆ_(k|k) (or an output estimated value z^(v) _(k|k)) to satisfy this H_(∞) evaluation criterion is given by a hyper H_(∞) filter of level γ_(f): $\begin{matrix} {{\overset{\Cup}{z}}_{k|k} = {H_{k}{\hat{x}}_{k|k}}} & (10) \\ {{\hat{x}}_{k|k} = {{F_{k - 1}{\hat{x}}_{{k - 1}|{k - 1}}} + {K_{s,k}\left( {y_{k} - {H_{k}F_{k - 1}{\hat{x}}_{{k - 1}|{k - 1}}}} \right)}}} & (11) \\ {K_{s,k} = {{\hat{\Sigma}}_{k|{k - 1}}{H_{k}^{T} \cdot \left( {{H_{k}{\hat{\Sigma}}_{k|{k - 1}}H_{k}^{T}} + \rho} \right)^{- 1}}}} & (12) \\ {\left. \begin{matrix} {{\hat{\Sigma}}_{k|k} = {{\hat{\Sigma}}_{k|{k - 1}} - {{\hat{\Sigma}}_{k|{k - 1}}C_{k}^{T}R_{e,k}^{- 1}C_{k}{\hat{\Sigma}}_{k|{k - 1}}}}} \\ {{\hat{\Sigma}}_{{k + 1}|k} = {\left( {F_{k}{\hat{\Sigma}}_{k|k}F_{k}^{T}} \right)/\rho}} \end{matrix} \right\}{{where},}} & (13) \\ {{{e_{f,i} = {{\overset{\Cup}{z}}_{i|i} - {H_{i}x_{i}}}},\quad{{\hat{x}}_{0|0} = {\overset{\Cup}{x}}_{0}},\quad{{\hat{\Sigma}}_{1|0} = \Sigma_{0}}}{{R_{e,k} = {R_{k} + {C_{k}{\hat{\Sigma}}_{k|{k - 1}}C_{k}^{T}}}},\quad{R_{k} = \begin{bmatrix} \rho & 0 \\ 0 & {- {\rho\gamma}_{f}^{2}} \end{bmatrix}},\quad{C_{k} = \begin{bmatrix} H_{k} \\ H_{k} \end{bmatrix}}}} & (14) \\ {{{0 < \rho} = {{1 - {\chi\left( \gamma_{f} \right)}} \leq 1}},\quad{\gamma_{f} > 1}} & (15) \end{matrix}$ Incidentally, expression (11) denotes a filter equation, expression (12) denotes a filter gain, and expression (13) denotes a Riccati equation.

Besides, a drive matrix G_(k) is generated as follows. $\begin{matrix} {{G_{k}G_{k}^{T}} = {\frac{\chi\left( \gamma_{f} \right)}{\rho}F_{k}{\hat{\Sigma}}_{k|k}F_{k}^{T}}} & (16) \end{matrix}$

Besides, in order to improve the tracking capacity of the foregoing H_(∞) filter, the upper limit value γ_(f) is set to be as small as possible so as to satisfy the following existence condition. $\begin{matrix} {{{\hat{\Sigma}}_{i|i}^{- 1} = {{{\hat{\Sigma}}_{i|{i - 1}}^{- 1} + {\frac{1 - \gamma_{f}^{- 2}}{\rho}H_{i}^{T}H_{i}}} > 0}},\quad{i = 0},\ldots\quad,k} & (17) \end{matrix}$ Where, χ(γ_(f)) is a monotonically damping function of γ_(f), which satisfies χ(1)=1 and χ(∞)=0.

The feature of Theorem 1 is that the generation of robustness in the state estimation and the optimization of the forgetting factor ρ are simultaneously performed.

FIG. 2 shows a flowchart concerning the generation of robustness of the H_(∞) filter and the optimization of the forgetting factor ρ. Here,

block “EXC>0”: an existence condition of the H_(∞) filter, and Δγ: a positive real number.

First, the processing section 101 reads out or inputs the upper limit value γ_(f) from the storage section 105 or the input section 102 (S101). In this example, γ_(f)>>1 is given. The processing section 101 determines the forgetting factor ρ by expression (15) (S103). Thereafter, the processing section 101 executes the hyper H_(∞) filter of expression (10) to expression (13) based on the forgetting factor ρ (S105). The processing section 101 calculates expression (17) (or the right side (this is made EXC) of after-mentioned expression (18)) (S107), and when the existence condition is satisfied at all times (S109), γ_(f) is decreased by Δγ, and the same processing is repeated (S111). On the other hand, when the existence condition is not satisfied at a certain γ_(f) (S109), what is obtained by adding Δγ to the γ_(f) is made the optimal value γ_(f) ^(op) of γ_(f), and is outputted to the output section 103 and/or stored into the storage section 105 (S113). Incidentally, in this example, although Δγ is added, a previously set value other than that may be added. This optimization process is called a γ-iteration. Incidentally, the processing section 101 may store a suitable intermediate value and a final value obtained at respective steps, such as the H_(∞) filter calculation step S105 and the existence condition calculation step S107, into the storage section 105 as the need arises, and may read them from the storage section 105.

When the hyper H_(∞) filter satisfies the existence condition, the inequality of expression (9) is always satisfied. Thus, in the case where the disturbance energy of the denominator of expression (9) is limited, the total sum of the square estimated error of the numerator of expression (9) becomes bounded, and the estimated error after a certain time becomes 0. This means that when γ_(f) can be made smaller, the estimated value xˆ_(k|k) can quickly follow the change of the state X_(k).

Here, attention should be given to the fact that the algorithm of the hyper H_(∞) filter of Theorem 1 is different from that of the normal H_(∞) filter. Besides, when γ_(f)→∞, then ρ=1 and G_(k)=0, and the algorithm of the H_(∞) filter of Theorem 1 coincides with the algorithm of the Kalman filter.

FIG. 3 is a flowchart of the algorithm of the (hyper) H_(∞) filter (S105) in FIG. 2.

The hyper H_(∞) filtering algorithm can be summarized as follows.

[Step S201] The processing section 101 reads out the initial condition of a recursive expression from the storage section 105 or inputs the initial condition from the input section 102, and determines it as indicated in the figure.

Incidentally, L denotes a previously fixed maximum data number.

[Step S203] The processing section 101 compares the time k with the maximum data number L. When the time k is larger than the maximum data number, the processing section 101 ends the processing, and when not larger, advance is made to a next step. (If unnecessary, the conditional sentence can be removed. Alternatively, restart may be made as the need arises.)

[Step S205] The processing section 101 calculates a filter gain K_(s,k) by using expression (12).

[Step S207] The processing section 101 updates the filter equation of the hyper H_(∞) filter of expression (11).

[Step S209] The processing section 101 calculates terms Σˆ_(k|k), Σˆ_(k+1|k) corresponding to the covariance matrix of an error by using the Riccati equation of expression (13).

[Step S211] The time k is made to advance (k=k+1), return is made to step S203, and continuation is made as long as data exists.

Incidentally, the processing section 101 may store a suitable intermediate value, a final value, a value of the existence condition and the like obtained at the respective steps, such as the H_(∞) filter calculation steps S205 to S209, into the storage section 105 as the need arises, or may read them from the storage section 105.

(Scalar Existence Condition)

The amount of calculation O(N²) was necessary for the judgment of the existence condition of expression (17). However, when the following condition is used, the existence of the H_(∞) filter of Theorem 1, that is, expression (9) can be verified by the amount of calculation O(N).

Corollary 1: Scalar existence condition

When the following existence condition is used, the existence of the hyper H∞, filter can be judged by the amount of calculation O(N). $\begin{matrix} {{{{{{- \varrho}\quad{\hat{\Xi}}_{i}} + {\rho\gamma}_{f}^{2}} > 0},\quad{i = 0},\ldots\quad,k}{{Here},}} & (18) \\ {{\varrho = {1 - \gamma_{f}^{2}}},\quad{{\hat{\Xi}}_{i} = \frac{\rho\quad H_{i}K_{s,i}}{1 - {H_{i}K_{s,i}}}},\quad{\rho = {1 - {\chi\left( \gamma_{f} \right)}}}} & (19) \end{matrix}$ Where, K_(s,i) denotes the filter gain obtained in expression (12). (Proof)

Hereinafter, the proof of the system 1 will be described.

When a characteristic equation $\begin{matrix} {{{{\lambda\quad I} - R_{e,k}}} = {\begin{matrix} {\lambda - \left( {\rho + {H_{k}{\hat{\Sigma}}_{k|{k - 1}}H_{k}^{T}}} \right)} & {{- H_{k}}{\hat{\Sigma}}_{k|{k - 1}}H_{k}^{T}} \\ {{- H_{k}}{\hat{\Sigma}}_{k|{k - 1}}H_{k}^{T}} & {\lambda - \left( {{- {\rho\gamma}_{f}^{2}} + {H_{k}{\hat{\Sigma}}_{k|{k - 1}}H_{k}^{T}}} \right)} \end{matrix}}} \\ {= {\lambda^{2} - {\left( {{2H_{k}{\hat{\Sigma}}_{k|{k - 1}}H_{k}^{T}} + {\rho\varrho}} \right)\lambda} - {\rho^{2}\gamma_{f}^{2}} + {{\rho\varrho}\quad H_{k}{\hat{\Sigma}}_{k|{k - 1}}H_{k}^{T}}}} \\ {= 0} \end{matrix}$ of a 2×2 matrix R_(e,k) is solved, an eigenvalue λ_(i) of R_(e,k) is obtained as follows. $\lambda_{i} = \frac{\Phi \pm \sqrt{\Phi^{2} - {4{\rho\varrho}\quad H_{k}{\hat{\Sigma}}_{k|{k - 1}}H_{k}^{T}} + {4\rho^{2}\gamma_{f}^{2}}}}{2}$ Where,  Φ = 2H_(k)Σ̂_(k|k − 1)H_(k)^(T) + ρ𝜚,  𝜚 = 1 − γ_(f)² If − 4ρ𝜚  H_(k)Σ̂_(k|k − 1)H_(k)^(T) + 4ρ²γ_(f)² > 0 one of two eigenvalues of the matrix R_(e,k) becomes positive, the other becomes negative, and the matrixes R_(k) and R_(e,k) have the same inertia. By this, when ${{H_{k}{\hat{\Sigma}}_{k|{k - 1}}H_{k}^{T}} = \frac{H_{k}{\overset{\sim}{K}}_{k}}{1 - {\frac{1 - \gamma_{f}^{- 2}}{\rho}H_{k}{\overset{\sim}{K}}_{k}}}},{{H_{k}{\overset{\sim}{K}}_{k}} = \frac{\rho\quad H_{k}K_{s,k}}{1 - {\gamma_{f}^{2}H_{k}K_{s,k}}}}$ is used, the existence condition of expression (₁₈) is obtained. Here, the amount of calculation of H_(k) K_(s,k) is O(N). 4. State Estimation Algorithm Which Is Numerically Stable

Since the foregoing hyper H_(∞) filter updates Σˆ_(k|k−∈)R^(n×n), the amount of calculation per unit time step becomes O(N²), that is, an arithmetic operation proportional to N² becomes necessary. Here, N denotes the dimension of the state vector x_(k). Thus, as the dimension of x_(k) is increased, the calculation time required for execution of this filter is rapidly increased. Besides, although the error covariance matrix Σˆ_(k|k−1) must always have the positive definite from its property, there is a case where it has numerically the negative definite. Especially, in the case where calculation is made at single precision, this tendency becomes remarkable. At this time, it is known that the filter becomes unstable. Thus, in order to put the algorithm to practical use and to reduce the cost, the development of the state estimation algorithm which can be operated even at single precision (example: 32 bit) is desired.

Then, next, attention is paid to R_(k=R) ^(1/2) _(k)J₁R^(T/2) _(k), R_(e,k=R) ^(1/2) _(e,k)J₁ ^(T/2) _(e,k), Σˆ_(k|k−1)=Σˆ1/2 _(k|k−1)Σˆ^(T/2) _(k|k−1) and an H_(∞) filter (square root array algorithm) of Theorem ₁, which is numerically stabilized, is indicated in Theorem 2. Here, although it is assumed that F_(k)=I is established for simplification, it can be obtained in the same way also in the case of F_(k)≠I. Hereinafter, the hyper H_(∞) filter to realize the state estimation algorithm which is numerically stable will be indicted. $\begin{matrix} \left( {{Theorem}\quad 2} \right) & \quad \\ {{\hat{x}}_{k|k} = {{\hat{x}}_{{k - 1}|{k - 1}} + {K_{s,k}\left( {y_{k} - {H_{k}{\hat{x}}_{{k - 1}|{k - 1}}}} \right)}}} & (20) \\ {{K_{s,k} = {{K_{k}\left( {:{,1}} \right)}/{R_{e,k}\left( {1,1} \right)}}},{K_{k} = {{\rho^{\frac{1}{2}}\left( {\rho^{- \frac{1}{2}}K_{k}R_{e,k}^{- \frac{1}{2}}J_{1}^{- 1}} \right)}J_{1}R_{e,k}^{\frac{1}{2}}}}} & (21) \\ {{{\begin{bmatrix} R_{k}^{\frac{1}{2}} & {C_{k}{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}} \\ 0 & {\rho^{- \frac{1}{2}}{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}} \end{bmatrix}{\Theta(k)}} = \begin{bmatrix} R_{e,k}^{\frac{1}{2}} & 0 \\ {\rho^{- \frac{1}{2}}K_{k}R_{e,k}^{- \frac{1}{2}}J_{1}^{- 1}} & {\hat{\Sigma}}_{{k + 1}|k}^{\frac{1}{2}} \end{bmatrix}}{{Where},}} & (22) \\ {{{R_{k} = {R_{k}^{\frac{1}{2}}J_{1}R_{k}^{\frac{T}{2}}}},{R_{k}^{\frac{1}{2}} = \begin{bmatrix} \rho^{\frac{1}{2}} & 0 \\ 0 & {\rho^{\frac{1}{2}}\gamma_{f}} \end{bmatrix}},{J_{1} = \begin{bmatrix} 1 & 0 \\ 0 & {- 1} \end{bmatrix}},{{\hat{\Sigma}}_{k|{k - 1}} = {{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}{\hat{\Sigma}}_{k|{k - 1}}^{\frac{T}{2}}}}}{{R_{e,k} = {R_{k} + {C_{k}{\hat{\Sigma}}_{k|{k - 1}}C_{k}^{T}}}},\quad{C_{k} = \begin{bmatrix} H_{k} \\ H_{k} \end{bmatrix}},{R_{e,k} = {R_{e,k}^{\frac{1}{2}}J_{1}R_{e,k}^{\frac{T}{2}}}},{{\hat{x}}_{0|0} = {\overset{\Cup}{x}}_{0}}}} & (23) \end{matrix}$ Θ(k) denotes a J-unitary matrix, that is, satisfies Θ(k)JΘH(k)^(T)=J, J=(J₁⊕(I), I denotes a unit matrix, K_(k)(:,1) denotes a column vector of a first column of the matrix K_(k).

Incidentally, in expressions (21) and (22), J¹ ⁻¹ and J₁ can be deleted.

FIG. 4 is an explanatory view of the square root array algorithm of Theorem 2. This calculation algorithm can be used in the calculation (S105) of the H_(∞) filter in the flowchart of Theorem 1 shown in FIG. 2.

In this estimation algorithm, instead of obtaining Σˆ_(k|k−1) by a Riccati type update expression, its factor matrix Σˆ^(1/2) _(k|k−1)∈R^(N×N) (square root matrix of Σˆ_(k|k−1)) is obtained by the update expression based on the J-unitary transformation. From a 1-1 block matrix and a 2-1 block matrix generated at this time, the filter gain K_(s,k) is obtained as shown in the figure. Thus, Σˆ_(k|k)=Σˆ^(1/2) _(k|K−)Σˆ^(T/2) _(k|k−1)>0 is established, the positive definite property of Σˆ_(k|k−1) is ensured, and it can be numerically stabilized. Incidentally, a computational complexity of the H_(∞) filter of Theorem 2 per unit step remains O (N²).

Incidentally, in FIG. 4, J₁ ⁻¹ can be deleted.

First, the processing section 101 reads out terms contained in the respective elements of the left-side equations of expression (22) from the storage section 105 or obtains them from the internal memory or the like, and executes the J-unitary transformation (S301). The processing section 101 calculates system gains K_(k) and K_(s,k) from the elements of the right-side equations of the obtained expression (22) based on expression (₂₁) (S303, S305). The processing section 101 calculates the state estimated value xˆ_(k|k) based on expression (20) (S307).

5. Numerically Stable Fast Algorithm for State Estimation

As described above, a computational complexity of the H_(∞) filter of Theorem ₂ per unit step remains O(N²). Then, as a countermeasure for the complexity, by using that when H _(k)=H _(k+1)Ψ,H _(k)=[u(k), . . . , u(0), 0, . . . , 0], a covariance matrix Σ _(k+1k|k) of one step prediction error of x _(k)=[X^(T) _(k),O^(T)]^(T) satisfies $\begin{matrix} {{{{\underset{\_}{\Sigma}}_{{k + 1}❘{k}} - {\Psi\quad{\underset{\_}{\Sigma}}_{k|{k - 1}}\Psi^{T}}} = {{- {\underset{\_}{L}}_{k}}R_{r,k}^{- 1}{\underset{\_}{L}}_{k}^{T}}},\quad{{\underset{\_}{L}}_{k} = \begin{bmatrix} {\overset{\sim}{L}}_{k} \\ 0 \end{bmatrix}}} & (24) \end{matrix}$ consideration is given to updating L _(k) (that is, L{tilde over ( )}_(k)) with a low dimension instead of Σ _(k+1|k). Here, when attention is paid to R_(r,k)=R^(1/2) _(r,k)SR^(T/2) _(r,k), next Theorem 3 can be obtained. $\begin{matrix} \left( {{Theorem}\quad 3} \right) & \quad \\ {{\hat{x}}_{k|k} = {{\hat{x}}_{{k - 1}|{k - 1}} + {K_{s,k}\left( {y_{k} - {H_{k}{\hat{x}}_{{k - 1}|{k - 1}}}} \right)}}} & (61) \\ {{K_{s,k} + {{K_{k}\left( {:{,1}} \right)}/{R_{e,k}\left( {1,1} \right)}}},\quad{K_{k} = {{\rho^{\frac{1}{2}}\left( {{\overset{\_}{K}}_{k}R_{e,k}^{- \frac{1}{2}}} \right)}R_{e,k}^{\frac{1}{2}}}}} & (62) \\ {\begin{bmatrix} R_{e,{k + 1}}^{\frac{1}{2}} & 0 \\ {\begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix}R_{e,{k + 1}}^{- \frac{T}{2}}J_{1}} & {{\overset{\sim}{L}}_{k + 1}R_{r,{k + 1}}^{- \frac{T}{2}}} \end{bmatrix} = {\begin{bmatrix} R_{e,{k + 1}}^{\frac{1}{2}} & {{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}R_{r,k}^{- \frac{1}{2}}} \\ {\begin{bmatrix} 0 \\ {\quad{\overset{\quad\_}{K}}_{\quad k}} \end{bmatrix}R_{e,k}^{- \frac{1}{2}}J_{1}} & {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}R_{r,k}^{- \frac{1}{2}}} \end{bmatrix}{\Theta(k)}}} & (63) \end{matrix}$ here, Θ(k) denotes an arbitrary J-unitary matrix, and {hacek over (C)}_(k+1)Ψis established, where $\begin{matrix} {{{R_{k} = {R_{k}^{\frac{1}{2}}J_{1}R_{k}^{\frac{T}{2}}}},{R_{k}^{\frac{1}{2}} = \begin{bmatrix} p^{\frac{1}{2}} & 0 \\ 0 & {\rho^{\frac{1}{2}}\gamma_{f}} \end{bmatrix}},{J_{1} = \begin{bmatrix} 1 & 0 \\ 0 & {- 1} \end{bmatrix}},{{\hat{\Sigma}}_{k|{k - 1}} = {{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}{\hat{\Sigma}}_{k|{k - 1}}^{\frac{T}{2}}}}}{{R_{e,k} = {R_{k} + {C_{k}{\hat{\Sigma}}_{k|{k - 1}}C_{k}^{T}}}},{C_{k} = \begin{bmatrix} H_{k} \\ H_{k} \end{bmatrix}},{R_{e,k} = {R_{e,k}^{\frac{1}{2}}J_{1}R_{e,k}^{\frac{T}{2}}}},{{\hat{x}}_{0|0} = {\overset{\Cup}{x}}_{0}}}} & (23) \end{matrix}$

Incidentally, the proof of Theorem 3 will be described later.

The above expression can be arranged with respect to K_(k) instead of K⁻ _(k)(=P^(−1/2)K_(k)).

Further, when the following J-unitary matrix Θ(k)=(J ₁ R _(e,k) ^(1/2) ⊕−R _(r,k) ^(1/2))Σ(k)(R _(e,k+1) ^(T/2) J ₁ ⁻¹ ⊕−R _(r,k+1) ^(T/2)) is used, a fast state estimation algorithm of Theorem 4 can be obtained. Where, Ψ denotes a shift matrix. $\begin{matrix} \left( {{Theorem}\quad 4} \right) & \quad \\ {{\hat{x}}_{k\quad|k}\quad = \quad{{\hat{x}}_{{k - 1}|{k - 1}} + {K_{s,k}\left( {y_{k} - {H_{k}\quad{\hat{x}}_{{k -}\quad|{k - 1}}}} \right)}}} & (25) \\ {K_{s,k} = {\rho^{\frac{1}{2}}{{{\overset{\_}{K}}_{k}\left( {:{,1}} \right)}/{R_{e,k}\left( {1,1} \right)}}}} & (26) \\ {\begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix} = {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} - {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} & (27) \\ {{\overset{\sim}{L}}_{k + 1} = {{\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}} - {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}}} & (28) \\ {R_{e,{k + 1}} = {R_{e,k} - {{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} & (29) \\ {{R_{r,{k + 1}} = {R_{r,k} - {{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}}}{{Where},}} & (30) \\ {{{{\overset{\Cup}{C}}_{k + 1} = \begin{bmatrix} {\overset{.}{H}}_{k + 1} \\ {\overset{\Cup}{H}}_{k + 1} \end{bmatrix}},{{\overset{\Cup}{H}}_{k + 1} = {\left\lbrack {u_{k + 1}{u\left( {k + 1 - N} \right)}} \right\rbrack = \left\lbrack {{u\left( {k + 1} \right)}u_{k}} \right\rbrack}},{{\overset{\Cup}{H}}_{1} = \left\lbrack {{u(1)},0,\ldots\quad,0} \right\rbrack}}{{R_{e,1} = {R_{1} + {{\overset{\Cup}{C}}_{1}{\overset{\Cup}{\Sigma}}_{1|0}{\overset{\Cup}{C}}_{1}^{T}}}},{R_{1} = \begin{bmatrix} \rho & 0 \\ 0 & {{- \rho}\quad\gamma_{f}^{2}} \end{bmatrix}},{{\overset{\Cup}{\Sigma}}_{1|0} = {{diag}\quad\left\{ {\rho^{2},\rho^{3},\ldots\quad,\rho^{N + 2}} \right\}}},{\rho = {1 - {\chi\left( \gamma_{f} \right)}}}}{{{\overset{\sim}{L}}_{0} = {\begin{bmatrix} 1 & 0 \\ 0 & 0 \\ 0 & 1 \end{bmatrix} \in \mathcal{R}^{{({N + 1})} \times 2}}},{R_{r,0} = \begin{bmatrix} {- 1} & 0 \\ 0 & {- \rho^{N}} \end{bmatrix}},{{\overset{\_}{K}}_{0} = 0},{{\hat{x}}_{0|0} = {\hat{x}}_{0}},{{\overset{\_}{K}}_{k} = {\rho^{- \frac{1}{2}}K_{k}}}}} & (31) \end{matrix}$ diag[·] denotes a diagonal matrix, and R_(e,k+1)(1,1) denotes a ₁-₁ element of the matrix R_(e,k+1). Besides, the above expression can be arranged with respect to K_(k) instead of K⁻ _(k).

In the fast algorithm, since the filter gain K_(s,k) is obtained by the update of L{tilde over ( )}_(k)∈R^((N+1)×2) in the following factoring $\begin{matrix} {{{\underset{\_}{\Sigma}}_{{k + 1}|k} - {\Psi\quad{\underset{\_}{\Sigma}}_{k|{k - 1}}\Psi^{T}}} = {{- {\underset{\_}{L}}_{k}}R_{r,k}^{- 1}{\underset{\_}{L}}_{k}^{T}}} & (32) \end{matrix}$ O(N+₁) is sufficient for the amount of calculation per unit step. Here, attention should be paid to the following expression. ${\begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix} - \begin{bmatrix} 0 \\ {\overset{\_}{k}}_{K} \end{bmatrix}} = {\rho^{- \frac{1}{2}}\left( {{{\underset{\_}{\Sigma}}_{{k + 1}|k}{\overset{\Cup}{C}}_{k}^{T}} - {\Psi\quad{\underset{\_}{\Sigma}}_{k|{k - 1}}{\overset{\Cup}{C}}_{k}^{T}}} \right)}$

FIG. 5 is one example of a flowchart of a numerically stable fast algorithm of Theorem 4. The fast algorithm is incorporated in the calculation step (S105) of the H_(∞) filter of FIG. 2, and is optimized by the γ-iteration. Thus, during a period in which the existence condition is satisfied, γ_(f) is gradually decreased, however, at the time point when it comes to be unsatisfied, γ_(i) is increased as indicated in the figure.

The H_(∞) filtering algorithm can be summarized as follows.

[Step S401] The processing section 101 determines an initial condition of the recursive expression as indicated in the figure. Incidentally, L denotes a maximum data number.

[Step S403] The processing section 101 compares the time k with the maximum data number L. When the time k is larger than the maximum data number, the processing section 101 ends the processing, and when not larger, advance is made to a next step. (When unnecessary, the conditional sentence can be removed. Alternatively, restart is made.)

[Step S405] The processing section 101 recursively calculates a term K_(k+1) corresponding to a filter gain by using expressions (27) and (31).

[Step S406] The processing section 101 recursively calculates R_(e,k+1) by using expression (29).

[Step S407] The processing section 101 further calculates K_(s,k) by using expressions (26) and (31).

[Step S409] The processing section 101 judges the existence condition EXC>₀ here, and when the existence condition is satisfied, advance is made to step S411.

[Step S413] On the other hand, when the existence condition is not satisfied at step S409, the processing section 101 increases γ_(f), and return is made to step S401.

[Step S411] The processing section 101 updates the filter equation of the H_(∞) filter of expression (25).

[Step S415] The processing section 101 recursively calculates R_(r,k+1) by using expression (30). Besides, the processing section 101 recursively calculates L⁻ _(k+1) by using expressions (28) and (31).

[Step S419] The processing section 101 advances the time k (k=k+1), returns to step S403, and continues as long as data exists.

Incidentally, the processing section 101 may store a suitable intermediate value and a final value obtained at the respective steps, such as the H_(∞) filter calculation steps S405 to S415 and the calculation step S409 of the existence condition, into the storage section 105 as the need arises, and may read them from the storage section 105.

6. Echo Canceller

Next, a mathematical model of an echo canceling problem is generated.

First, when consideration is given to the fact that a received signal {u_(k)} becomes an input signal to an echo path, by a (time-varying) impulse response {h_(i)[k]} of the echo path, an observed value {Y_(k)} of an echo {d_(k)} is expressed by the following expression. $\begin{matrix} {{y_{k} = {{d_{k} + v_{k}} = {{\sum\limits_{i = 0}^{N - 1}{{h_{i}\lbrack k\rbrack}u_{k - i}}} + v_{k}}}},{k = 0},1,2,\ldots} & (33) \end{matrix}$ Here, u_(k) and y_(k) respectively denote the received signal and the echo at a time t_(k) (=kT; T is a sampling period), v_(k) denotes circuit noise having a mean value of 0 at the time t_(k), h_(i[k], i=)0, . . . , N−1 denotes a time-varying impulse response, and the tap number N thereof is known. At this time, when estimated values {hˆ_(i)[k]} of the impulse response are obtained every moment, a pseudo-echo as indicated below can be generated by using that. $\begin{matrix} {{{\hat{d}}_{k} = {\sum\limits_{i = 0}^{N - 1}{{{\hat{h}}_{i}\lbrack k\rbrack}u_{k - i}}}},{k = 0},1,2,\ldots} & (34) \end{matrix}$ When this is subtracted from the echo (Y_(k)−dˆ_(k)≈₀), the echo can be cancelled. Where, it is assumed that if k−i<0, then u_(k−1)=0.

From the above, the problem can be reduced to the problem of successively estimating the impulse response {h_(i)[k]} of the echo path from the received signal {u_(k)} and the echo {y_(k)} which can be directly observed.

In general, in order to apply the H_(∞) filter to the echo canceller, first, expression (32) must be expressed by a state space model including a state equation and an observation equation. Then, since the problem is to estimate the impulse response {h_(i)[k]}, when {h_(i)[k]} is made a state variable x_(k), and a variance of about w_(k) is allowed, the following state space model can be established for the echo path. x _(k+1) =x _(k) +G _(k) w _(k) ,x _(k) ,w _(k)∈R^(N)  (35) y _(k) =H _(k) x _(k) +u _(k) ,y _(k) ,u _(k) ∈R  (36) z _(k) =H _(k) x _(k) ,z _(k) ∈R,H _(k) ∈R ^(1×N)  (37) Where, X _(k) =[h ₀ [k], . . . ,h _(N−) [k]] ^(T) ,w _(k) [w _(k)(1), . . . , 2_(k)(N)]^(T) H _(k) =[u _(k) , . . . , u _(k−N+1)]

The hyper and fast H_(∞) filtering algorithms to the state space model as stated above is as described before. Besides, at the estimation of the impulse response, when the generation of a transmission signal is detected, the estimation is generally suspended during that.

7. Evaluation to Impulse Response

(Confirmation of Operation)

With respect to the case where the impulse response of the echo pulse is temporally invariable (h_(i)[k]=h_(i)), and the tap number N is 48, the operation of the fast algorithm is confirmed by using a simulation. $\begin{matrix} {y_{k} = {{\sum\limits_{i = 0}^{47}{h_{i}u_{k - i}}} + v_{k}}} & (38) \end{matrix}$ Incidentally, FIG. 6 is a view showing values of the impulse response {h_(i)} here.

Here, the value shown in the figure are used for the impulse response {h_(i)}_(i=0) ²³, and the other {h_(i)}_(i=24) ⁴⁷ is made 0. Besides, it is assumed that υ_(k) is stationary Gaussian white noise having a mean value of 0 and variance σ_(v) ²=1.0×10⁻⁶, and the sampling period T is made 1.0 for convenience.

Besides, the received signal {u_(k)} is approximated by a secondary AR model as follows. u _(k)=α₁ u _(k·1)+α₂ u _(k·2) +w _(k) ^(′)  (39) Where, α₁=0.7 and α₂=0.1 are assumed, and w_(k)′ denotes stationary Gaussian white noise having a means value of 0 and variance σ_(w′) ²=0.04. (Estimation Result of Impulse Response)

FIG. 7 shows an estimation result of the impulse response by the numerically stable fast algorithm of Theorem 4. Here, the vertical axis of FIG. 7(b) indicates √{Σ_(i=0) ⁴⁷(h _(i) −xˆ _(k)(i ₊₁))²}.

By this, it is understood that the estimation can be excellently performed by the fast algorithm. Where, ρ=1−χ(γ_(f)),χ(γ_(f))=γ_(f) ⁻²,xˆ_(0|0)=0 and Σˆ_(0|0)=20I were assumed, and the calculation was performed at double precision. Besides, while the existence condition is confirmed, γ_(f)=5.5 was set.

8. Proof of Theorem

8-1. Proof of Theorem 2

When the following expression: $\begin{matrix} {\begin{matrix} \begin{bmatrix} R_{k}^{\frac{1}{2}} & {C_{k}{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}} \\ 0 & {\rho^{- \frac{1}{2}}{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}} \end{bmatrix} \\ {J\begin{bmatrix} R_{k}^{\frac{T}{2}} & 0 \\ {{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}C_{k}^{T}} & {\rho^{- \frac{1}{2}}{\hat{\Sigma}}_{k|{k - 1}}^{\frac{T}{2}}} \end{bmatrix}} \end{matrix} = \begin{matrix} \begin{bmatrix} R_{e,k}^{\frac{1}{2}} & 0 \\ {{\rho^{- \frac{1}{2}}K_{k}R_{e,k}^{- \frac{1}{2}}J_{1}^{- 1}}\quad} & {\quad{\hat{\Sigma}}_{{k + 1}|k}^{\frac{1}{2}}} \end{bmatrix} \\ {J\begin{bmatrix} R_{e,k}^{\frac{T}{2}} & {\rho^{- \frac{1}{2}}J_{1}^{- 1}R_{e,k}^{- \frac{T}{2}}K_{k}^{T}} \\ 0 & {\hat{\Sigma}}_{{k + 1}|k}^{\frac{T}{2}} \end{bmatrix}} \end{matrix}} & (40) \end{matrix}$ is established, following expressions are obtained by comparing the respective terms of 2×2 block matrixes of both sides. $\begin{matrix} {R_{e,k} = {R_{k} + {C_{k}{\hat{\Sigma}}_{k|{k - 1}}C_{k}^{T}}}} & (41) \\ {K_{k} = {{\hat{\Sigma}}_{k|{k - 1}}C_{k}^{T}}} & (42) \\ {{{\hat{\Sigma}}_{k|{k - 1}} + {\rho^{- 1}K_{k}R_{e,k}^{- 1}K_{k}^{T}}} = {\rho^{- 1}{\hat{\Sigma}}_{k|{k - 1}}}} & (43) \end{matrix}$

This is coincident with the Riccati equation of expression (13) at F_(k)=I of Theorem 1. Where, $\begin{matrix} {{J = \left( {J_{1} \oplus I} \right)},{J_{1} = \begin{bmatrix} 1 & 0 \\ 0 & {- 1} \end{bmatrix}},{C_{k} = \begin{bmatrix} H_{k} \\ H_{k} \end{bmatrix}}} & (44) \end{matrix}$

On the other hand, when AJA^(T)=BJB^(T) is established, B can be expressed as B=AΘ(k) by using the J-unitary matrix Θ(K). Thus, from expression (40), the Riccati equation of Theorem 1 is equivalent to the following expression. $\begin{matrix} {\begin{bmatrix} R_{e,k}^{\frac{1}{2}} & 0 \\ {\rho^{- \frac{1}{2}}K_{k}R_{e,k}^{- \frac{1}{2}}J_{1}^{- 1}} & {\hat{\Sigma}}_{{k + 1}|k}^{\frac{1}{2}} \end{bmatrix} = {\begin{bmatrix} R_{k}^{\frac{1}{2}} & {C_{k}{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}} \\ 0 & {\rho^{- \frac{1}{2}}{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}} \end{bmatrix}{\Theta(k)}}} & (45) \end{matrix}$

Incidentally, in expressions (40) and (45), J₁ ⁻¹ can be deleted.

8-2. Proof of Theorem 3

It is assumed that there is a J-unitary matrix Θ(k) which performs block triangulation as follows. $\begin{bmatrix} X & 0 \\ Y & Z \end{bmatrix} = {\begin{bmatrix} R_{e,k}^{\frac{1}{2}} & {{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}R_{r,k}^{- \frac{1}{2}}} \\ {\left\lbrack \frac{0}{K_{k}} \right\rbrack R_{e,k}^{- \frac{1}{2}}J_{1}} & {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}R_{r,k}^{- \frac{1}{2}}} \end{bmatrix}{{\Theta(k)}.}}$ At this time, when both sides J=(J₁⊕−S)-norm of the above expression are compared, X, Y and Z of the left side can be determined as follows. Where, S denote a diagonal matrix in which diagonal elements take 1 or −1. (1,1)-Block matrix $\begin{matrix} {{{XJ}_{1}X^{T}} = {R_{e,k} - {{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} \\ {= {R_{e,k} + {{{\overset{\Cup}{C}}_{k + 1}\left( {{\overset{\Cup}{\Sigma}}_{{k + 1}|k} - {\Psi\quad{\overset{\Cup}{\Sigma}}_{k|{k - 1}}\Psi^{T}}} \right)}{\overset{\Cup}{C}}_{k + 1}^{T}}}} \\ {= {R_{e,k} + {{\overset{\Cup}{C}}_{k + 1}{\overset{\Cup}{\Sigma}}_{{k + 1}|k}{\overset{\Cup}{C}}_{k + 1}^{T}} - {{\overset{\Cup}{C}}_{k}{\overset{\Cup}{\Sigma}}_{k|{k - 1}}{\overset{\Cup}{C}}_{k}^{T}}}} \\ {= {{R_{e,k} + \left( {R_{e,{k + 1}} - R_{k + 1}} \right) - \left( {R_{e,k} - R_{k}} \right)} = R_{e,{k + 1}}}} \end{matrix}$ Thus, X=R_(e,k+1) ^(1/2) is obtained from R_(e,k+1)=R_(e,k+1)J₁R_(e,k+1) ^(T/2),R_(k+1)=R_(k) Here, attention should be paid to the fact that J ₁ ⁻¹ =J ₁(J ₁ ² =I),S ⁻¹ =S,R _(e,k+1) ^(T) =R _(e,k+1) ,R _(r,k) ^(T) =R _(r,k) ,R _(r,k) ⁻¹ =R _(r,k) ^(T/2) SR _(r,k) ^(−1/2) ,Ĉ _(k) =Ĉ _(k+1)Ψ(Ĉ _(k) ^(T)=Ψ^(T) Ĉ _(k+1) ^(T)) is established. (2,1)-Block matrix $\begin{matrix} {{{YJ}_{1}X^{T}} = {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} - {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} \\ {= {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} + {{\rho^{- \frac{1}{2}}\left( {{\overset{\Cup}{\Sigma}}_{{k + 1}|k} - {\Psi\quad{\overset{\Cup}{\Sigma}}_{k|{k - 1}}\Psi^{T}}} \right)}{\overset{\Cup}{C}}_{k + 1}^{T}}}} \\ {= {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} + {\rho^{- \frac{1}{2}}\left( {{{\overset{\Cup}{\Sigma}}_{{k + 1}|k}{\overset{\Cup}{C}}_{k + 1}^{T}} - {\Psi\quad{\overset{\Cup}{\Sigma}}_{k|{k - 1}}{\overset{\Cup}{C}}_{k}^{T}}} \right)}}} \\ {= {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} + \begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix} - \begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix}}} \\ {= \begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix}} \end{matrix}$ By this, $Y = {\begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix}R_{e,{k + 1}}^{- \frac{T}{2}}J_{1}}$ is obtained. Where, ${\overset{\Cup}{C}}_{k}^{T} = \left( {{\overset{\Cup}{C}}_{k + 1}\Psi} \right)^{T}$ (2,2)-Block Matrix $\begin{matrix} {{{- {ZSZ}^{T}} + {{YJ}_{1}Y^{T}}} = {{\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix}{R_{e,k}^{- 1}\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix}}^{T}} - {\rho^{- 1}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}}}} \\ {= {{\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix}{R_{e,k}^{- 1}\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix}}^{T}} + {\rho^{- 1}\left( {{\overset{\Cup}{\Sigma}}_{{k + 1}|k} - {\Psi\quad{\overset{\Cup}{\Sigma}}_{k|{k - 1}}\Psi^{T}}} \right)}}} \\ {= {{\rho^{- 1}{\Psi\left( {{\begin{bmatrix} K_{k} \\ 0 \end{bmatrix}{R_{e,k}^{- 1}\begin{bmatrix} K_{k} \\ 0 \end{bmatrix}}^{T}} - {\overset{\Cup}{\Sigma}}_{k|{k - 1}}} \right)}\Psi^{T}} + {\rho^{- 1}{\overset{\Cup}{\Sigma}}_{{k + 1}|k}}}} \\ {= {{{- \Psi}{\overset{\Cup}{\Sigma}}_{{k + 1}|k}\Psi^{T}} + {\overset{\Cup}{\Sigma}}_{{k + 2}|{k + 1}} + {\begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix}{R_{e,{k + 1}}^{- 1}\begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix}}^{T}}}} \end{matrix}$

By this, −ZSZ^(T={circumflex over (Σ)}) _(k+2|k+1)−Ψ{circumflex over (Σ)}_(k+1|k)Ψ^(t)=−{tilde over (L)}_(k+1)R_(r,k+1) ^(−T/2)SR_(r,k+1) ^(−1/2){tilde over (L)}_(k+1) ^(T) and Z={tilde over (L)}_(k+1)R_(r,k+1) ^(−T/2) is obtained.

8-3. Proof of Theorem 4

When an observation matrix H_(k) has a shift characteristic and J=(J ₁ ⊕−S), the following relational expression is obtained by a similar method to Theorem 2. $\begin{matrix} {{\begin{bmatrix} R_{e,{k + 1}} & 0 \\ \begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix} & {\overset{\sim}{L}}_{k + 1} \end{bmatrix} = {\begin{bmatrix} R_{e,k} & {{\overset{\Cup}{C}}_{k + 1}\overset{\sim}{L}} \\ \begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} & {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}} \end{bmatrix}{\Sigma(k)}}}{{Where},{{\Theta(k)} = {\left( {{J_{1}R_{e,k}^{\frac{1}{2}}} \oplus {- R_{r,k}^{\frac{1}{2}}}} \right){\sum{(k)\left( {{R_{e,{k + 1}}^{- \frac{T}{2}}J_{1}^{- 1}} \oplus {- R_{r,{k + 1}}^{- \frac{T}{2}}}} \right)}}}}}} & (46) \\ {{{\Sigma(k)} = \begin{bmatrix} I & {{- R_{e,k}^{- 1}}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}} \\ {{- R_{r,k}^{- 1}}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}} & I \end{bmatrix}}{{Where},{{{\Sigma(k)}^{T}\left( {R_{e,k} \oplus {- R_{r,k}}} \right)\quad{\Sigma(k)}} = \left( {R_{e,{k + 1}} \oplus {- R_{r,{k + 1}}}} \right)}}} & \left( {4\quad 7} \right) \end{matrix}$ and R_(r,k+1) is determined so that Σ9k0 ^(t)(R_(e,k)⊕−R_(r,k))Σ(k)=(R_(e,k+1)⊕−R_(r,k+1)) is established. Next, when an update expression of R_(r,k+1) is newly added to the third line of expression (46), the following expression is finally obtained. $\begin{matrix} \begin{matrix} {\begin{bmatrix} {\quad R_{\quad{e,\quad{k\quad + \quad 1}}}} & 0 \\ \begin{bmatrix} {\quad{\quad\overset{\quad\_}{K}}_{\quad{k\quad + \quad 1}}} \\ 0 \end{bmatrix} & {\quad{\quad\overset{\sim}{L}}_{k\quad + \quad 1}} \\ 0 & {\quad R_{\quad{r,\quad{k\quad + \quad 1}}}} \end{bmatrix} = {\begin{bmatrix} R_{e,k} & {{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}} \\ \begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} & {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}} \\ {{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}} & R_{r,k} \end{bmatrix}\begin{bmatrix} I & {{- R_{e,k}^{- 1}}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}} \\ {{- R_{r,k}^{- 1}}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}} & I \end{bmatrix}}} \\ {{Where},\quad{= \begin{bmatrix} {R_{e,k} - {{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}} & 0 \\ {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} - {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}} & {{\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}} - {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}} \\ 0 & {R_{r,k} - {{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}} \end{bmatrix}}} \end{matrix} & (48) \end{matrix}$

From the correspondence of the respective terms of 3×2 block matrixes of both sides, the following update expression of a gain matrix K⁻ _(k) is obtained. $\begin{matrix} {\begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix} = {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} - {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} & (49) \\ {{\overset{\sim}{L}}_{k + 1} = {{\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}} - {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}}} & (50) \\ {R_{e,{k + 1}} = {R_{e,k} - {{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} & (51) \\ {R_{r,{k + 1}} = {R_{r,k} - {{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}}} & (52) \end{matrix}$

INDUSTIRAL APPLICABILITY

In general, in a normal civil communication equipment or the like, calculation is often performed at single precision in view of the cost and speed. Thus, as the practical state estimation algorithm, the present invention would have effects in various industrial fields. Besides, the invention can be applied to an echo canceller in a communication system or a sound system, sound field reproduction, noise control and the like.

Although embodiments of the invention have been shown and described, it is to be understood that various modifications and substitutions, as well as rearrangements of method steps and equipment, parts and components, can be made by those skilled in the art without departing from the novel spirit and scope of the invention 

1. (canceled)
 2. The system estimation method according to claim 7, wherein the processing section calculates the existence condition in accordance with a following expression: $\begin{matrix} {{{\hat{\Sigma}}_{i|i}^{- 1} = {{\Sigma_{i|{i - 1}}^{- 1} + {\frac{1 - \gamma_{f}^{- 2}}{\rho}H_{i}^{T}H_{i}}} > 0}},{i = 0},\ldots\quad,k} & (17) \end{matrix}$
 3. The system estimation method according to claim 7, wherein the processing section calculates the existence condition in accordance with a following expression: $\begin{matrix} {{{{{{- \varrho}\quad{\hat{\Xi}}_{i}} + {\rho\gamma}_{f}^{2}} > 0},\quad{i = 0},\ldots\quad,k}{{here},}} & (18) \\ {{\varrho = {1 - \gamma_{f}^{2}}},{{\hat{\Xi}}_{i} = \frac{\rho\quad H_{i}K_{s,i}}{1 - {H_{i}K_{s,i}}}},{\rho = {1 - {\chi\left( \gamma_{f} \right)}}}} & (19) \end{matrix}$ where the forgetting factor ρ and the upper limit value γ_(f) have a following relation: 0<ρ=1−χ(γ_(f))≦1, where χ(γ_(f)) denotes a monotonically damping function of γ_(f) to satisfy χ(1)=1 and χ(∞)=0. 4-6. (canceled)
 7. A system estimation method for making state estimation robust and optimizing a forgetting factor ρ simultaneously in an estimation algorithm, in which for a state space model expressed by following expressions: X _(k+1) =F _(k) x _(k) +G _(k) w _(k) y _(k) =H _(k) x _(k) +v _(k) z _(k) =J _(k) x _(k) here, x_(k): a state vector or simply a state, w_(k): a system noise, v_(k): an observation noise, y_(k): an observation signal, z_(k): an output signal, F_(k): dynamics of a system, and G_(k): a drive matrix, as an evaluation criterion, a maximum value of an energy gain which indicates a ratio of a filter error to a disturbance including the system noise w_(k) and the observation noise v_(k) and is weighted with the forgetting factor ρ is suppressed to be smaller than a term corresponding to a previously given upper limit value γ_(f), and the system estimation method comprises: a step at which a processing section inputs the upper limit value γ_(f), the observation signal y_(k) as an input of a filter and a value including an observation matrix H_(k) from a storage section or an input section; a step at which the processing section determines the forgetting factor ρ relevant to the state space model in accordance with the upper limit value γ_(f); a step of executing a hyper H_(∞) filter at which the processing section reads out an initial value or a value including the observation matrix H_(k) at a time from the storage section and obtains a filter gain K_(s,k) by using the forgetting factor ρ and a gain matrix K_(k) and by following expressions (20) to (22), or, expression (20) and expressions which are deleted J₁ ⁻¹ and J₁, in the expressions (21) and (22),: $\begin{matrix} {{\hat{x}}_{k\quad|k}\quad = \quad{{\hat{x}}_{{k - 1}|{k - 1}} + {K_{s,k}\left( {y_{k} - {H_{k}\quad{\hat{x}}_{{k - 1}\quad|{k - 1}}}} \right)}}} & (20) \\ {{K_{s,k} = {{K_{k}\left( {:{,1}} \right)}/{R_{e,k}\left( {1,1} \right)}}},{K_{k} = {{\rho^{\frac{1}{2}}\left( {\rho^{- \frac{1}{2}}K_{k}R_{e,k}^{- 1}J_{1}^{- 1}} \right)}J_{1}R_{e,k}^{\frac{1}{2}}}}} & (21) \\ {{{\begin{bmatrix} \begin{matrix} R_{k}^{\frac{1}{2}} & \quad \end{matrix} & {{C_{k}\quad{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}}\quad} \\ 0 & {\rho^{- \frac{1}{2}}{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}} \end{bmatrix}{\Theta(k)}} = \begin{bmatrix} R_{e,k}^{\frac{1}{2}} & 0 \\ {\rho^{- \frac{1}{2}}K_{k}R_{e,k}^{- \frac{1}{2}}J_{1}^{- 1}} & {\hat{\Sigma}}_{{k + 1}|k}^{\frac{1}{2}} \end{bmatrix}}{{Where},}} & (22) \\ {{{R_{k} = {R_{k}^{\frac{1}{2}}J_{1}R_{k}^{\frac{T}{2}}}},{R_{k}^{\frac{1}{2}} = \begin{bmatrix} \rho^{\frac{1}{2}} & 0 \\ 0 & {\rho^{\frac{1}{2}}\gamma_{f}} \end{bmatrix}},{J_{1} = \begin{bmatrix} 1 & 0 \\ 0 & {- 1} \end{bmatrix}},{{\hat{\Sigma}}_{k|{k - 1}} = {{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}{\hat{\Sigma}}_{k|{k - 1}}^{\frac{T}{2}}}}}{{R_{e,k} = {R_{k} + {C_{k}{\hat{\Sigma}}_{k|{k - 1}}C_{k}^{T}}}},{C_{k} = \begin{bmatrix} H_{k} \\ H_{k} \end{bmatrix}},{R_{e,k} = {R_{e,k}^{\frac{1}{2}}J_{1}R_{e,k}^{\frac{T}{2}}}},{{\hat{x}}_{0|0} = {\overset{\Cup}{x}}_{0}}}} & (23) \end{matrix}$ Θ(k) denotes a J-unitary matrix, that is, satisfies Θ(k) JΘH(k)^(T)=J, J=(J₁⊕I), I denotes a unit matrix, K_(k)(:, 1) denotes a column vector of a first column of the matrix K_(k), here, xˆ_(k|k): the estimated value of the state x_(k) at the time k using the observation signals y₀ to y_(k), y_(k): the observation signal, F_(k): the dynamics of the system, K_(s,k): the filter gain, H_(k): the observation matrix, Σˆ_(k|k): corresponding to a covariance matrix of an error of xˆ_(k|k), Θ(k): the J-unitary matrix, and R_(e,k): an auxiliary variable, a step at which the processing section stores an estimated value of the state x_(k) by the hyper H_(∞), filter into the storage section; a step at which the processing section calculates an existence condition based on the upper limit value γ_(f) and the forgetting factor ρ by the obtained observation matrix H_(i) or the observation matrix H_(i) and the filter gain K_(s,i), and a step at which the processing section sets the upper limit value to be small within a range where the existence condition is satisfied at each time and stores the value into the storage section, by decreasing the upper limit value γ_(f) and repeating the step of executing the hyper H_(∞), filter.
 8. The system estimation method according to claim 7, wherein the step of executing the hyper H_(∞) filter includes: a step at which the processing section calculates Σˆ_(k+1|k) ^(1/2) by using the expression (22); a step at which the processing section calculates the filter gain K_(s,k) based on an initial condition of Σˆ_(k|k−1) and an initial condition of C_(k), by using the expression (21); a step at which the processing section updates a filter equation of the H_(∞) filter of the expression (20); and a step at which the processing section repeatedly executes the step of calculating by using the expression (20), the step of calculating by using the expression (21) and, the step of updating while advancing the time k.
 9. A system estimation method for making state estimation robust and optimizing a forgetting factor ρ simultaneously in an estimation algorithm, in which for a state space model expressed by following expressions: X _(k+1) =F _(k) x _(k) +G _(k) w _(k) y _(k) =H _(k) x _(k) +v _(k) z _(k) =H _(k) x _(k) here, x_(k): a state vector or simply a state, w_(k): a system noise, v_(k): an observation noise, y_(k): an observation signal, z_(k): an output signal, F_(k): dynamics of a system, and G_(k): a drive matrix, as an evaluation criterion, a maximum value of an energy gain which indicates a ratio of a filter error to a disturbance including the system noise w_(k) and the observation noise v_(k) and is weighted with the forgetting factor ρ is suppressed to be smaller than a term corresponding to a previously given upper limit value γ_(f), and the system estimation method comprises: a step at which a processing section inputs the upper limit value γ_(f), the observation signal y_(k) as an input of a filter and a value including an observation matrix H_(k) from a storage section or an input section; a step at which the processing section determines the forgetting factor ρ relevant to the state space model in accordance with the upper limit value γ_(f) a step of executing a hyper H_(∞) filter at which the processing section reads out an initial value or a value including the observation matrix H_(k) at a time from the storage section and obtains a filter gain K_(s,k) by using the forgetting factor ρ and a gain matrix K_(k) and by following expressions: $\begin{matrix} {{\hat{x}}_{k|k} = {{\hat{x}}_{{k - 1}|{k - 1}} + {K_{s,k}\left( {y_{k} - {H_{k}{\hat{x}}_{{k - 1}|{k - 1}}}} \right)}}} & (61) \\ {{K_{s,k} + {{K_{k}\left( {:{,1}} \right)}/{R_{e,k}\left( {1,1} \right)}}},\quad{K_{k} = {{\rho^{\frac{1}{2}}\left( {{\overset{\_}{K}}_{k}R_{e,k}^{- \frac{1}{2}}} \right)}R_{e,k}^{\frac{1}{2}}}}} & (62) \\ {\begin{bmatrix} R_{e,{k + 1}}^{\frac{1}{2}} & 0 \\ {\begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix}R_{e,{k + 1}}^{- \frac{T}{2}}J_{1}} & {{\overset{\sim}{L}}_{k + 1}R_{r,{k + 1}}^{- \frac{T}{2}}} \end{bmatrix} = {\begin{bmatrix} R_{e,{k + 1}}^{\frac{1}{2}} & {{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}R_{r,k}^{- \frac{1}{2}}} \\ {\begin{bmatrix} 0 \\ {\quad{\overset{\quad\_}{K}}_{\quad k}} \end{bmatrix}R_{e,k}^{- \frac{1}{2}}J_{1}} & {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}R_{r,k}^{- \frac{1}{2}}} \end{bmatrix}{\Theta(k)}}} & (63) \end{matrix}$ here, Θ(k) denotes an arbitrary J-unitary matrix, and Ĉ_(k)=Ĉ_(k+1)Ψ is established, where $\begin{matrix} {{{R_{k} = {R_{k}^{\frac{1}{2}}J_{1}R_{k}^{\frac{T}{2}}}},{R_{k}^{\frac{1}{2}} = \begin{bmatrix} \rho^{\frac{1}{2}} & 0 \\ 0 & {\rho^{\frac{1}{2}}\gamma_{f}} \end{bmatrix}},{J_{1} = \begin{bmatrix} 1 & 0 \\ 0 & {- 1} \end{bmatrix}},{{\hat{\Sigma}}_{k|{k - 1}} = {{\hat{\Sigma}}_{k|{k - 1}}^{\frac{1}{2}}{\hat{\Sigma}}_{k|{k - 1}}^{\frac{T}{2}}}}}{{R_{r,k} = {R_{k} + {C_{k}{\hat{\Sigma}}_{k|{k - 1}}C_{k}^{T}}}},{C_{k} = \begin{bmatrix} H_{k} \\ H_{k} \end{bmatrix}},{R_{e,k} = {R_{e,k}^{\frac{1}{2}}J_{1}R_{e,k}^{\frac{T}{2}}}},{{\hat{x}}_{0|0} = {\overset{\Cup}{x}}_{0}}}} & (23) \end{matrix}$ here, xˆ_(k|k): the estimated value of the state x_(k) at the time k using the observation signals y₀ to y_(k), y_(k): the observation signal, K_(s,k): the filter gain, H_(k): the observation matrix, Θ(k): the J-unitary matrix, and R_(e,k): an auxiliary variable, a step at which the processing section stores an estimated value of the state x_(k) by the hyper H_(∞) filter into the storage section; a step at which the processing section calculates an existence condition based on the upper limit value γ_(f) and the forgetting factor ρ by the obtained observation matrix H_(i) or the observation matrix H_(i) and the filter gain K_(s,i), and a step at which the processing section sets the upper limit value to be small within a range where the existence condition is satisfied at each time and stores the value into the storage section, by decreasing the upper limit value γ_(f) and repeating the step of executing the hyper H_(∞) filter.
 10. The system estimation method according to claim 9, wherein the step of executing the hyper H_(∞) filter includes: a step at which the processing section calculates K⁻ _(k) based on an initial condition of R_(e,k+1), R_(r,k+1) and L{tilde over ( )}_(k+1) by using the expression (63); a step at which the processing section calculates the filter gain K_(s,k) based on the initial condition and by using the expression (62); a step at which the processing section updates a filter equation of the H_(∞) filter of the expression (61); and a step at which the processing section repeatedly executes the step of calculating by using the expression (63), the step of calculating by using the expression (62), and, the step of updating while advancing the time k.
 11. A system estimation method for making state estimation robust and optimizing a forgetting factor ρ simultaneously in an estimation algorithm, in which for a state space model expressed by following expressions: X _(k+1) =F _(k) x _(k) +G _(k) w _(k) y _(k) =H _(k) x _(k) +v _(k) z _(k) =H _(k) x _(k) here, x_(k): a state vector or simply a state, w_(k): a system noise, v_(k): an observation noise, y_(k): an observation signal, z_(k): an output signal, F_(k): dynamics of a system, and G_(k): a drive matrix, as an evaluation criterion, a maximum value of an energy gain which indicates a ratio of a filter error to a disturbance including the system noise w_(k) and the observation noise v_(k) and is weighted with the forgetting factor ρ is suppressed to be smaller than a term corresponding to a previously given upper limit value γ_(f), and the system estimation method comprises: a step at which a processing section inputs the upper limit value γ_(f), the observation signal y_(k) as an input of a filter and a value including an observation matrix H_(k) from a storage section or an input section; a step at which the processing section determines the forgetting factor ρ relevant to the state space model in accordance with the upper limit value γ_(f) a step of executing a hyper H_(∞), filter at which the processing section reads out an initial value or a value including the observation matrix H_(k) at a time from the storage section and obtains a filter gain K_(s,k) by using the forgetting factor ρ and a gain matrix K⁻ _(k) and by following expressions: $\quad\begin{matrix} {{\hat{x}}_{k\quad|k}\quad = \quad{{\hat{x}}_{{k - 1}|{k - 1}} + {K_{s,k}\left( {y_{k} - {H_{k}\quad{\hat{x}}_{{k - \quad 1}|{k - 1}}}} \right)}}} & {(25)\quad} \\ {K_{s,k} = {\rho^{\frac{1}{2}}{{{\overset{\_}{K}}_{k}\left( {:{,1}} \right)}/{R_{e,k}\left( {1,1} \right)}}}} & {(26)\quad} \\ {\begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix} = {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} - {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} & {(27)\quad} \\ {{\overset{\sim}{L}}_{k + 1} = {{\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}} - {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}}} & {(28)\quad} \\ {R_{e,{k + 1}} = {R_{e,k} - {{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} & {(29)\quad} \\ {{R_{r,{k + 1}} = {R_{r,k} - {{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}}}{{Where},}} & {(30)\quad} \\ {{{{\overset{\Cup}{C}}_{k + 1} = \begin{bmatrix} {\overset{.}{H}}_{k + 1} \\ {\overset{\Cup}{H}}_{k + 1} \end{bmatrix}},{{\overset{\Cup}{H}}_{k + 1} = {\left\lbrack {u_{k + 1}{u\left( {k + 1 - N} \right)}} \right\rbrack = \left\lbrack {{u\left( {k + 1} \right)}u_{k}} \right\rbrack}},{{\overset{\Cup}{H}}_{1} = \left\lbrack {{u(1)},0,\ldots\quad,0} \right\rbrack}}{{R_{e,1} = {R_{1} + {{\overset{\Cup}{C}}_{1}{\overset{\Cup}{\Sigma}}_{1|0}{\overset{\Cup}{C}}_{1}^{T}}}},{R_{1} = \begin{bmatrix} \rho & 0 \\ 0 & {{- \rho}\quad\gamma_{f}^{2}} \end{bmatrix}},{{\overset{\Cup}{\Sigma}}_{1|0} = {{diag}\quad\left\{ {\rho^{2},\rho^{3},\ldots\quad,\rho^{N + 2}} \right\}}},{\rho = {1 - {\chi\left( \gamma_{f} \right)}}}}{{{\overset{\sim}{L}}_{0} = {\begin{bmatrix} 1 & 0 \\ 0 & 0 \\ 0 & 1 \end{bmatrix} \in \mathcal{R}^{{({N + 1})} \times 2}}},{R_{r,0} = \begin{bmatrix} {- 1} & 0 \\ 0 & {- \rho^{N}} \end{bmatrix}},{{\overset{\_}{K}}_{0} = 0},{{\hat{x}}_{0|0} = {\hat{x}}_{0}},{{\overset{\_}{K}}_{k} = {\rho^{- \frac{1}{2}}K_{k}}}}} & {(31)\quad} \end{matrix}$ here, y_(k): the observation signal, F_(k): the dynamics of the system, H_(k): the observation matrix, xˆ_(k|k): the estimated value of the state x_(k) at the time k using the observation signals y₀ to y_(k,) K_(s,k): the filter gain, obtained from the gain matrix K⁻ _(k), and R_(e,k),L{tilde over ( )}_(k): an auxiliary variable, a step at which the processing section stores an estimated value of the state x_(k) by the hyper H_(∞) filter into the storage section; a step at which the processing section calculates an existence condition based on the upper limit value γ_(f) and the forgetting factor ρ by the obtained observation matrix H_(i) or the observation matrix H_(i) and the filter gain K_(s,i), and a step at which the processing section sets the upper limit value to be small within a range where the existence condition is satisfied at each time and stores the value into the storage section, by decreasing the upper limit value γ_(f) and repeating the step of executing the hyper H_(∞) filter.
 12. (canceled)
 13. The system estimation method according to claim 7, wherein an estimated value z^(v) _(k|k) of the output signal is obtained from the state estimated value xˆ_(k|k) at the time k by a following expression: z^(v) _(k|k)=H_(k)xˆ_(k|k).
 14. The system estimation method according to claim 7, wherein the H_(∞) filter equation is applied to obtain the state estimated value xˆ_(k|k)=[hˆ₁[k],□□□,hˆ_(N)[k]] a pseudo-echo is estimated by a following expression: $\begin{matrix} {{{\hat{d}}_{k} = {\sum\limits_{i = 0}^{N - 1}{{{\hat{h}}_{i}\lbrack k\rbrack}u_{k - i}}}},{k = 0},1,2,\ldots} & (34) \end{matrix}$ and an echo canceller is realized by canceling an actual echo by the obtained pseudo-echo.
 15. A system estimation program for causing a computer to make state estimation robust and to optimize a forgetting factor ρ simultaneously in an estimation algorithm, in which for a state space model expressed by following expressions: X _(k+1) =F _(k) x _(k) +G _(k) w _(k) y _(k) =H _(k) x _(k) +v _(k) z _(k) =H _(k) x _(k) here, x_(k): a state vector or simply a state, w_(k): a system noise, v_(k): an observation noise, y_(k): an observation signal, z_(k): an output signal, F_(k): dynamics of a system, and G_(k): a drive matrix, as an evaluation criterion, a maximum value of an energy gain which indicates a ratio of a filter error to a disturbance including the system noise w_(k) and the observation noise v_(k) and is weighted with the forgetting factor ρ is suppressed to be smaller than a term corresponding to a previously given upper limit value γ_(f), and the system estimation program causes the computer to execute: a step at which a processing section inputs the upper limit value γ_(f), the observation signal y_(k) as an input of a filter and a value including an observation matrix H_(k) from a storage section or an input section; a step at which the processing section determines the forgetting factor ρ relevant to the state space model in accordance with the upper limit value γ_(f) a step of executing a hyper H_(∞) filter at which the processing section reads out an initial value or a value including the observation matrix H_(k) at a time from the storage section and obtains a filter gain K_(s,k) by using the forgetting factor ρ and a gain matrix K⁻ _(k) and by following expressions: $\begin{matrix} {{\hat{x}}_{k\quad|k}\quad = \quad{{\hat{x}}_{{k - 1}|{k - 1}} + {K_{s,k}\left( {y_{k} - {H_{k}\quad{\hat{x}}_{{k - 1}\quad|{k - 1}}}} \right)}}} & {(25)\quad} \\ {K_{s,k} = {\rho^{\frac{1}{2}}{{{\overset{\_}{K}}_{k}\left( {:{,1}} \right)}/{R_{e,k}\left( {1,1} \right)}}}} & {(26)\quad} \\ {\begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix} = {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} - {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} & {(27)\quad} \\ {{\overset{\sim}{L}}_{k + 1} = {{\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}} - {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}}} & {(28)\quad} \\ {R_{e,{k + 1}} = {R_{e,k} - {{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} & {(29)\quad} \\ {{R_{r,{k + 1}} = {R_{r,k} - {{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}}}{{Where},}} & {(30)\quad} \\ {{{{\overset{\Cup}{C}}_{k + 1} = \begin{bmatrix} {\overset{.}{H}}_{k + 1} \\ {\overset{\Cup}{H}}_{k + 1} \end{bmatrix}},{{\overset{\Cup}{H}}_{k + 1} = {\left\lbrack {u_{k + 1}{u\left( {k + 1 - N} \right)}} \right\rbrack = \left\lbrack {{u\left( {k + 1} \right)}u_{k}} \right\rbrack}},{{\overset{\Cup}{H}}_{1} = \left\lbrack {{u(1)},0,\ldots\quad,0} \right\rbrack}}{{R_{e,1} = {R_{1} + {{\overset{\Cup}{C}}_{1}{\overset{\Cup}{\Sigma}}_{1|0}{\overset{\Cup}{C}}_{1}^{T}}}},{R_{1} = \begin{bmatrix} \rho & 0 \\ 0 & {{- \rho}\quad\gamma_{f}^{2}} \end{bmatrix}},{{\overset{\Cup}{\Sigma}}_{1|0} = {{diag}\quad\left\{ {\rho^{2},\rho^{3},\ldots\quad,\rho^{N + 2}} \right\}}},{\rho = {1 - {\chi\left( \gamma_{f} \right)}}}}{{{\overset{\sim}{L}}_{0} = {\begin{bmatrix} 1 & 0 \\ 0 & 0 \\ 0 & 1 \end{bmatrix} \in \mathcal{R}^{{({N + 1})} \times 2}}},{R_{r,0} = \begin{bmatrix} {- 1} & 0 \\ 0 & {- \rho^{N}} \end{bmatrix}},{{\overset{\_}{K}}_{0} = 0},{{\hat{x}}_{0|0} = {\hat{x}}_{0}},{{\overset{\_}{K}}_{k} = {\rho^{- \frac{1}{2}}K_{k}}}}} & {(31)\quad} \end{matrix}$ here, y_(k): the observation signal, F_(k): the dynamics of the system, H_(k): the observation matrix, xˆ_(k|k): the estimated value of the state x_(k) at the time k using the observation signals y₀ to y_(k,) K_(s,k): the filter gain, obtained from the gain matrix K⁻ _(k), and R_(e,k), L{tilde over ( )}_(k): an auxiliary variable, a step at which the processing section stores an estimated value of the state x_(k) by the hyper H_(∞) filter into the storage section; a step at which the processing section calculates an existence condition based on the upper limit value γ_(f) and the forgetting factor ρ by the obtained observation matrix H_(i) or the observation matrix H_(i) and the filter gain K_(s,i), and a step at which the processing section sets the upper limit value to be small within a range where the existence condition is satisfied at each time and stores the value into the storage section, by decreasing the upper limit value γ_(f) and repeating the step of executing the hyper H_(∞) filter.
 16. A computer readable recording medium recording a system estimation program for causing a computer to make state estimation robust and to optimize a forgetting factor ρ simultaneously in an estimation algorithm, in which for a state space model expressed by following expressions: X _(k+1) =F _(k) x _(k) +G _(k) w _(k) y _(k) =H _(k) x _(k) +v _(k) z _(k) =H _(k) x _(k) here, x_(k): a state vector or simply a state, w_(k): a system noise, v_(k): an observation noise, y_(k): an observation signal, z_(k): an output signal, F_(k): dynamics of a system, and G_(k): a drive matrix, as an evaluation criterion, a maximum value of an energy gain which indicates a ratio of a filter error to a disturbance including the system noise w_(k) and the observation noise v_(k) and is weighted with the forgetting factor ρ is suppressed to be smaller than a term corresponding to a previously given upper limit value γ_(f), and the computer readable recording medium recording the system estimation program causes the computer to execute: a step at which a processing section inputs the upper limit value γ_(f), the observation signal y_(k) as an input of a filter and a value including an observation matrix H_(k) from a storage section or an input section; a step at which the processing section determines the forgetting factor ρ relevant to the state space model in accordance with the upper limit value γ_(f;) a step of executing a hyper H_(∞) filter at which the processing section reads out an initial value or a value including the observation matrix H_(k) at a time from the storage section and obtains a filter gain K_(s,k) by using the forgetting factor ρ and a gain matrix K⁻ _(k) and by following expressions: $\begin{matrix} {{\hat{x}}_{k|k} = {{\hat{x}}_{{k - 1}|{k - 1}} + {K_{s,k}\left( {y_{k} - {H_{k}{\hat{x}}_{{k - 1}|{k - 1}}}} \right)}}} & (25) \\ {K_{s,k} = {\rho^{\frac{1}{2}}{{{\overset{\_}{K}}_{k}\left( {:{,1}} \right)}/{R_{e,k}\left( {1,1} \right)}}}} & (26) \\ {\begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix} = {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} - {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} & (27) \\ {{\overset{\sim}{L}}_{k + 1} = {{\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}} - {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}}} & (28) \\ {R_{e,{k + 1}} = {R_{e,k} - {{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} & (29) \\ {{R_{r,{k + 1}} = {R_{r,k} - {{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}}}{{Where},{{\overset{\Cup}{C}}_{k + 1} = \begin{bmatrix} {\overset{\Cup}{H}}_{k + 1} \\ {\overset{\Cup}{H}}_{k + 1} \end{bmatrix}},{{\overset{\Cup}{H}}_{k + 1} = {\left\lbrack {u_{k + 1}{u\left( {k + 1 - N} \right)}} \right\rbrack = \left\lbrack {{u\left( {k + 1} \right)}\quad u_{k}} \right\rbrack}},{{\overset{\Cup}{H}}_{1} = \left\lbrack {{u(1)},0,\ldots\quad,0} \right\rbrack}}{{R_{e,1} = {R_{1} + {{\overset{\Cup}{C}}_{1}{\overset{\Cup}{\Sigma}}_{1|0}{\overset{\Cup}{C}}_{1}^{T}}}},{R_{1} = \begin{bmatrix} \rho & 0 \\ 0 & {{- \rho}\quad\gamma_{f}^{2}} \end{bmatrix}},{{\overset{\Cup}{\Sigma}}_{1|0} = {{diag}\left\{ {\rho^{2},\rho^{3},\ldots\quad,\rho^{N + 2}} \right\}}},{\rho = {1 - {\chi\left( \gamma_{f} \right)}}}}{{\overset{\sim}{L}}_{0} = {\begin{bmatrix} 1 & 0 \\ 0 & 0 \\ 0 & 1 \end{bmatrix} \in \mathcal{R}^{{({N + 1})} \times 2}}},{R_{r,0} = \begin{bmatrix} {- 1} & 0 \\ 0 & \rho^{- N} \end{bmatrix}},{{\overset{\_}{K}}_{0} = 0},\quad{{\hat{x}}_{0|0} = {\overset{\Cup}{x}}_{0}},\quad{{\overset{\_}{K}}_{k} = {\rho^{- \frac{1}{2}}K_{k}}}} & \begin{matrix} (30) \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ (31) \end{matrix} \end{matrix}$ here, y_(k): the observation signal, F_(k): the dynamics of the system, H_(k): the observation matrix, xˆ_(k|k): the estimated value of the state x_(k) at the time k using the observation signals y₀ to y_(k,) K_(s,k): the filter gain, obtained from the gain matrix K⁻ _(k), and R_(e,k), L{tilde over ( )}_(k): an auxiliary variable, a step at which the processing section stores an estimated value of the state x_(k) by the hyper H_(∞) filter into the storage section; a step at which the processing section calculates an existence condition based on the upper limit value γ_(f) and the forgetting factor ρ by the obtained observation matrix H_(i) or the observation matrix H_(i) and the filter gain K_(s,i), and a step at which the processing section sets the upper limit value to be small within a range where the existence condition is satisfied at each time and stores the value into the storage section, by decreasing the upper limit value γ_(f) and repeating the step of executing the hyper H_(∞) filter.
 17. A system estimation device for making state estimation robust and optimizing a forgetting factor ρ simultaneously in an estimation algorithm, in which for a state space model expressed by following expressions: X _(k+1) =F _(k) x _(k) +G _(k) w _(k) y _(k) =H _(k) x _(k) +v _(k) z _(k) =H _(k) x _(k) here, x_(k): a state vector or simply a state, w_(k): a system noise, v_(k): an observation noise, y_(k): an observation signal, z_(k): an output signal, F_(k): dynamics of a system, and G_(k): a drive matrix, as an evaluation criterion, a maximum value of an energy gain which indicates a ratio of a filter error to a disturbance including the system noise w_(k) and the observation noise v_(k) and is weighted with the forgetting factor ρ is suppressed to be smaller than a term corresponding to a previously given upper limit value γ_(f), and the system estimation device comprises: a processing section to execute the estimation algorithm; and a storage section to which reading and/or writing is performed by the processing section and which stores respective observed values, set values, and estimated values relevant to the state space model, further comprising: a means at which the processing section inputs the upper limit value γ_(f), the observation signal y_(k) as an input of a filter and a value including an observation matrix H_(k) from the storage section or an input section; a means at which the processing section determines the forgetting factor ρ relevant to the state space model in accordance with the upper limit value γ_(f;) a means of executing a hyper H_(∞) filter at which the processing section reads out an initial value or a value including the observation matrix H_(k) at a time from the storage section and obtains a filter gain K_(s,k) by using the fgttin factor ρ and a gain matrix K⁻ _(k) and by following expressions: $\begin{matrix} {{\hat{x}}_{k|k} = {{\hat{x}}_{{k - 1}|{k - 1}} + {K_{s,k}\left( {y_{k} - {H_{k}{\hat{x}}_{{k - 1}|{k - 1}}}} \right)}}} & (25) \\ {K_{s,k} = {\rho^{\frac{1}{2}}{{{\overset{\_}{K}}_{k}\left( {:{,1}} \right)}/{R_{e,k}\left( {1,1} \right)}}}} & (26) \\ {\begin{bmatrix} {\overset{\_}{K}}_{k + 1} \\ 0 \end{bmatrix} = {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix} - {\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} & (27) \\ {{\overset{\sim}{L}}_{k + 1} = {{\rho^{- \frac{1}{2}}{\overset{\sim}{L}}_{k}} - {\begin{bmatrix} 0 \\ {\overset{\_}{K}}_{k} \end{bmatrix}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}}} & (28) \\ {R_{e,{k + 1}} = {R_{e,k} - {{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}R_{r,k}^{- 1}{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}}}} & (29) \\ {{R_{r,{k + 1}} = {R_{r,k} - {{\overset{\sim}{L}}_{k}^{T}{\overset{\Cup}{C}}_{k + 1}^{T}R_{e,k}^{- 1}{\overset{\Cup}{C}}_{k + 1}{\overset{\sim}{L}}_{k}}}}{{Where},{{\overset{\Cup}{C}}_{k + 1} = \begin{bmatrix} {\overset{\Cup}{H}}_{k + 1} \\ {\overset{\Cup}{H}}_{k + 1} \end{bmatrix}},{{\overset{\Cup}{H}}_{k + 1} = {\left\lbrack {u_{k + 1}{u\left( {k + 1 - N} \right)}} \right\rbrack = \left\lbrack {{u\left( {k + 1} \right)}\quad u_{k}} \right\rbrack}},{{\overset{\Cup}{H}}_{1} = {\left\lbrack {{u(1)},0,\ldots\quad,0} \right\rbrack{R_{e,1} = {R_{1} + {{\overset{\Cup}{C}}_{1}{\overset{\Cup}{\Sigma}}_{1|0}{\overset{\Cup}{C}}_{1}^{T}}}}}},{R_{1} = \begin{bmatrix} \rho & 0 \\ 0 & {{- \rho}\quad\gamma_{f}^{2}} \end{bmatrix}},{{\overset{\Cup}{\Sigma}}_{1|0} = {{diag}\left\{ {\rho^{2},\rho^{3},\ldots\quad,\rho^{N + 2}} \right\}}},{\rho = {{1 - {{\chi\left( \gamma_{f} \right)}{\overset{\sim}{L}}_{0}}} = {\begin{bmatrix} 1 & 0 \\ 0 & 0 \\ 0 & 1 \end{bmatrix} \in \mathcal{R}^{{({N + 1})} \times 2}}}},{R_{r,0} = \begin{bmatrix} {- 1} & 0 \\ 0 & \rho^{- N} \end{bmatrix}},{{\overset{\_}{K}}_{0} = 0},\quad{{\hat{x}}_{0|0} = {\overset{\Cup}{x}}_{0}},\quad{{\overset{\_}{K}}_{k} = {\rho^{- \frac{1}{2}}K_{k}}}}} & \begin{matrix} (30) \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ \quad \\ (31) \end{matrix} \end{matrix}$ here, y_(k): the observation signal, F_(k): the dynamics of the system, H_(k): the observation matrix, xˆ_(k|k): the estimated value of the state x_(k) at the time k using the observation signals y₀ to y_(k,) K_(s,k): the filter gain, obtained from the gain matrix K⁻ _(k), and R_(e,k), L{tilde over ( )}_(k): an auxiliary variable, a means at which the processing section stores an estimated value of the state x_(k) by the hyper H_(∞) filter into the storage section; a means at which the processing section calculates an existence condition based on the upper limit value γ_(f) and the forgetting factor ρ by the obtained observation matrix H_(i) or the observation matrix H_(i) and the filter gain K_(s,i) and a means at which the processing section sets the upper limit value to be small within a range where the existence condition is satisfied at each time and stores the value into the storage section, by decreasing the upper limit value γ_(f) and repeating the means of executing the hyper H_(∞), filter.
 18. The system estimation method according to claim 9, wherein the processing section calculates the existence condition in accordance with a following expression: $\begin{matrix} {{{{{{- \varrho}{\hat{\Xi}}_{i}} + {\rho\quad\gamma_{f}^{2}}} > 0},\quad{i = 0},\ldots\quad,k}{{here},}} & (18) \\ {{\varrho = {1 - \gamma_{f}^{2}}},\quad{{\hat{\Xi}}_{i} = \frac{\rho\quad H_{i}K_{s,i}}{1 - {H_{i}K_{s,i}}}},\quad{\rho = {1 - {\chi\left( \gamma_{f} \right)}}}} & (19) \end{matrix}$ where the forgetting factor ρ and the upper limit value γ_(f) have a following relation: 0<ρ=1−χ(γ_(f))≦1, where χ(γ_(f)) denotes a monotonically damping function of γ_(f) to satisfy χ(1)=1 and χ(∞)=0.
 19. The system estimation method according to claim 9, wherein an estimated value Z^(v) _(k|k) of the output signal is obtained from the state estimated value xˆ_(k|k) at the time k by a following expression: z^(v) _(k|k=H) _(k)xˆ_(k|K).
 20. The system estimation method according to claim 9, wherein the H_(∞) filter equation is applied to obtain the state estimated value xˆ_(k|k)=[hˆ₁[k],□□□,hˆ_(N)[k]] a pseudo-echo is estimated by a following expression: $\begin{matrix} {{{\hat{d}}_{k} = {\sum\limits_{i = 0}^{N - 1}{{{\hat{h}}_{i}\lbrack k\rbrack}u_{k - i}}}},\quad{k = 0},1,2,\ldots} & (34) \end{matrix}$ and an echo canceller is realized by canceling an actual echo by the obtained pseudo-echo.
 21. The system estimation method according to claim 11, wherein the processing section calculates the existence condition in accordance with a following expression: $\begin{matrix} {{{{{{- \varrho}{\hat{\Xi}}_{i}} + {\rho\quad\gamma_{f}^{2}}} > 0},\quad{i = 0},\ldots\quad,k}{{here},}} & (18) \\ {{\varrho = {1 - \gamma_{f}^{2}}},\quad{{\hat{\Xi}}_{i} = \frac{\rho\quad H_{i}K_{s,i}}{1 - {H_{i}K_{s,i}}}},\quad{\rho = {1 - {\chi\left( \gamma_{f} \right)}}}} & (19) \end{matrix}$ where the forgetting factor ρ and the upper limit value γ_(f) have a following relation: 0<ρ=1−χ(γ_(f))<1, where χ(γ_(f)) denotes a monotonically damping function of γ_(f) to satisfy 102 (1)=1 and χ(∞)=0.
 22. The system estimation method according to claim 11, wherein an estimated value z^(v) _(k|k) of the output signal is obtained from the state estimated value xˆ_(k|k) at the time k by a following expression: z^(v) _(k|k)=H_(k)xˆ_(k|k).
 23. The system estimation method according to claim 11, wherein the H_(∞) filter equation is applied to obtain the state estimated value xˆ_(k|k)=[hˆ₁[k],□□□,hˆ_(N)[k]] a pseudo-echo is estimated by a following expression: $\begin{matrix} {{{\hat{d}}_{k} = {\sum\limits_{i = 0}^{N - 1}{{{\hat{h}}_{i}\lbrack k\rbrack}u_{k - i}}}},\quad{k = 0},1,2,\ldots} & (34) \end{matrix}$ and an echo canceller is realized by canceling an actual echo by the obtained pseudo-echo. 